Concept Drift Adaptation Methods under the Deep Learning Framework: A Literature Review

With the advent of the fourth industrial revolution, data-driven decision making has also become an integral part of decision making. At the same time, deep learning is one of the core technologies of the fourth industrial revolution that have become vital in decision making. However, in the era of epidemics and big data, the volume of data has increased dramatically while the sources have become progressively more complex, making data distribution highly susceptible to change. These situations can easily lead to concept drift, which directly affects the effectiveness of prediction models. How to cope with such complex situations and make timely and accurate decisions from multiple perspectives is a challenging research issue. To address this challenge, we summarize concept drift adaptation methods under the deep learning framework, which is beneficial to help decision makers make better decisions and analyze the causes of concept drift. First, we provide an overall introduction to concept drift, including the definition, causes, types, and process of concept drift adaptation methods under the deep learning framework. Second, we summarize concept drift adaptation methods in terms of discriminative learning, generative learning, hybrid learning, and others. For each aspect, we elaborate on the update modes, detection modes, and adaptation drift types of concept drift adaptation methods. In addition, we briefly describe the characteristics and application fields of deep learning algorithms using concept drift adaptation methods. Finally, we summarize common datasets and evaluation metrics and present future directions.

Book Review: Taking Literature and Language Learning Online: New Perspectives on Teaching, Research, and Technology

The creation of beautiful literature and art is one of humanity's most essential endeavours. The importance of literature as a component of the language-teaching curriculum has fluctuated over the last century with the popularity of various language-teaching pedagogies. Notwithstanding, it has recently seen a resurrection of appreciation for its effective utility in language acquisition. Covid-19 lockdown combined with the further progress of computer-assisted language learning has led to a gradual shift in the provision of literature-based language education to an online setting. Under this trend, Sandra Stadler-Heer and Amos Paran's edited chapter book Taking Literature and Language Learning Online: New Perspectives on Teaching, Research and Technology concentrates on a particular component of this transfer process, namely the interaction between literature and language learning. This book review provides an overview of this volume.

Performance, Trust, or both? COVID-19 Diagnosis and Prognosis using Deep Ensemble Transfer Learning on X-ray Imagesg±

The COVID-19 pandemic still affects most parts of the world today. Despite a lot of research on diagnosis, prognosis, and treatment, a big challenge today is the limited number of expert radiologists who provide diagnosis and prognosis on X-Ray images. Thus, to make the diagnosis of COVID-19 accessible and quicker, several researchers have proposed deep-learning-based Artificial Intelligence (AI) models. While most of these proposed machine and deep learning models work in theory, they may not find acceptance among the medical community for clinical use due to weak statistical validation. For this article, radiologists' views were considered to understand the correlation between the theoretical findings and real-life observations. The article explores Convolutional Neural Network (CNN) classification models to build a four-class viz. "COVID-19", "Lung Opacity", "Pneumonia", and "Normal"classifiers, which also provide the uncertainty measure associated with each class. The authors also employ various pre-processing techniques to enhance the X-Ray images for specific features. To address the issues of over-fitting while training, as well as to address the class imbalance problem in our dataset, we use Monte Carlo dropout and Focal Loss respectively. Finally, we provide a comparative analysis of the following classification models - ResNet-18, VGG-19, ResNet-152, MobileNet-V2, Inception-V3, and EfficientNet-V2, where we match the state-of-the-art results on the Open Benchmark Chest X-ray datasets, with a sensitivity of 0.9954, specificity of 0.9886, the precision of 0.9880, F1-score of 0.9851, accuracy of 0.9816, and receiver operating characteristic (ROC) of the area under the curve (AUC) of 0.9781 (ROC-AUC score). © 2022 ACM.

Proposed Convolution Architecture for Monkeypox Detection using Dermoscopy Images

Monkeypox is a skin disease that spreadsfrom animals to people and then people to people, the class of the monkeypox is zoonotic and its genus are othopoxvirus. There is no special treatment for monkeypox but the monkeypox and smallpox symptoms are almost similar, so the antiviral drug developed for prevent from smallpox virus may be used for monkeypox Infected person, the Prevention of monkeypox is just like COVID-19 proper hand wash, Smallpox vaccine, keep away from infected person, used PPE kits. In this paper Deep learning is use for detection of monkeypox with the help of CNN model, The Original Images contains a total number of 228 images, 102 belongs to the Monkeypox class and the remaining 126 represents the normal. But in deep learning greater amount of data required, data augmentation is also applied on it after this the total number of images are 3192. A variety of optimizers have been used to find out the best result in this paper, a comparison is usedbased on Loss, Accuracy, AUC, F1 score, Validation loss, Validation accuracy, validation AUC, Validation F1 score of each optimizer. after comparing alloptimizer, the Adam optimizer gives the best result its total testing accuracy is 92.21%, total number of epochs used for testing is 100. With the help of deep learning model Doctors are easily detect the monkeypox virus with the single image of infected person. © 2023 IEEE.

Rethinking Densely Connected Convolutional Networks for Diagnosing Infectious Diseases

Due to its high transmissibility, the COVID-19 pandemic has placed an unprecedented burden on healthcare systems worldwide. X-ray imaging of the chest has emerged as a valuable and cost-effective tool for detecting and diagnosing COVID-19 patients. In this study, we developed a deep learning model using transfer learning with optimized DenseNet-169 and DenseNet-201 models for three-class classification, utilizing the Nadam optimizer. We modified the traditional DenseNet architecture and tuned the hyperparameters to improve the model's performance. The model was evaluated on a novel dataset of 3312 X-ray images from publicly available datasets, using metrics such as accuracy, recall, precision, F1-score, and the area under the receiver operating characteristics curve. Our results showed impressive detection rate accuracy and recall for COVID-19 patients, with 95.98% and 96% achieved using DenseNet-169 and 96.18% and 99% using DenseNet-201. Unique layer configurations and the Nadam optimization algorithm enabled our deep learning model to achieve high rates of accuracy not only for detecting COVID-19 patients but also for identifying normal and pneumonia-affected patients. The model's ability to detect lung problems early on, as well as its low false-positive and false-negative rates, suggest that it has the potential to serve as a reliable diagnostic tool for a variety of lung diseases.

X-rays imaging analysis for early diagnosis of the thoracic disorders using Capsule Neural Network with Transfer learning

Over the past few years, millions of people around the world have developed thoracic ailments. MRI, CT scan, reverse transcription, and other methods are among those used to detect thoracic disorders. These procedures demand medical knowledge and are exceedingly pricy and delicate. An alternate and more widely used method to diagnose diseases of the chest is X-ray imaging. The goal of this study was to increase detection precision in order to develop a computationally assisted diagnostic tool. Different diseases can be identified by combining radiological imaging with various artificial intelligence application approaches. In this study, transfer learning (TL) and capsule neural network techniques are used to propose a method for the automatic detection of various thoracic illnesses utilizing digitized chest X-ray pictures of suspected patients. Four public databases were combined to build a dataset for this purpose. Three pre trained convolutional neural networks (CNNs) were utilized in TL with augmentation as a preprocessing technique to train and evaluate the model. Pneumonia, COVID19, normal, and TB (Tb) were the four class classifiers used to train the network to categorize. © 2023 IEEE.

Classifying Chest X-Ray Images using Residual Neural Network

This unprecedented time of the COVID-19 outbreak challenged the status-quo whether it is on business operation, political leadership, scientific capability, engineering implementation, data analysis, and strategic thinking, in terms of resiliency, agility, and innovativeness. Due to some identified constraints, while addressing the issue of global health, human ingenuity has proven again that in times of crisis, it is our best asset. Constraints like limited testing capacity and lack of real-time information regarding the spread of the virus, are the highest priority in the mitigation process, aside from the development of vaccines and the pushing through of vaccination programs. Using the available Chest X-Ray Images dataset and an AI-Computer Vision Technique called Convolutional Neural Network, features of the images were extracted and classified as COVID-19 positive or not. This paper proposes the usage of the 18-layer Residual Neural Network (ResNet-18) as an architecture instead of other ResNet with a higher number of layers. The researcher achieves the highest validation accuracy of 99.26%. Moving forward, using this lower number of layers in training a model classifier, resolves the issue of device constraints such as storage capacity and computing resources while still assuring highly accurate outputs. © 2022 IEEE.

An Investigation of Deep-Learned Features for Classifying Radiographic Images of COVID-19

In this proposal, a study based on deep-learned features via transfer learning was developed to obtain a set of features and techniques for pattern recognition in the context of COVID-19 images. The proposal was based on the ResNet-50, DenseNet-201 and EfficientNet-b0 deep-learning models. In this work, the chosen layer for analysis was the avg pool layer from each model, with 2048 features from the ResNet-50, 1920 features from the DenseNet0201 and 1280 obtained features from the EfficientNet-b0. The most relevant descriptors were defined for the classification process, applying the ReliefF algorithm and two classification strategies: individually applied classifiers and employed an ensemble of classifiers using the score-level fusion approach. Thus, the two best combinations were identified, both using the DenseNet-201 model with the same subset of features. The first combination was defined via the SMO classifier (accuracy of 98.38%) and the second via the ensemble strategy (accuracy of 97.89%). The feature subset was composed of only 210 descriptors, representing only 10% of the original set. The strategies and information presented here are relevant contributions for the specialists interested in the study and development of computer-aided diagnosis in COVID-19 images. Copyright © 2023 by SCITEPRESS - Science and Technology Publications, Lda. Under CC license (CC BY-NC-ND 4.0)

Masked Face Recognition System using Extended VGG-19

The scientific community has observed several issues as a result of COVID-19, both directly and indirectly. The use of face mask for health protection is crucial in the current COVID-19 scenario. Besides, ensuring the security of all people, from individuals to the state system, financial resources, diverse establishments, government, and non-government entities, is an essential component of contemporary life. Face recognition system is one of the most widely used security technology in modern life. In the presence of face masks, the performance of the current face recognition systems is not satisfactory. In this paper, we investigate a flexible solution that could be employed to recognize masked faces effectively. To do this, we develop a unique dataset to recognize the masked face, consisting of a frontal and lateral face with a mask. We propose an extended VGG19 deep model to improve the accuracy of the masked face recognition system. Then, we compare the accuracy of the proposed framework to that of well-known deep learning techniques, such as the standard Convolutional Neural Network (CNN) and the original VGG19. The experimental results demonstrate that the proposed extended VGG19 outperforms the investigated approaches. Quantitatively, the proposed model recognizes the frontal face with the mask with high accuracy of 96%. © 2022 IEEE.

Transfer Learning Model in Deep Neural Network for COVID-19 Prediction from CT Images

Deep learning models are often used to process radi-ological images automatically and can accurately train networks' weights on appropriate datasets. One of the significant benefits of the network is that it is possible to use the weight of a pre-trained network for other applications by fine-tuning the current weight. The primary purpose of this work is to employ a pre-trained deep neural framework known as transfer learning to detect and diagnose COVID-19 in CT images automatically. This paper uses a popular deep neural model, ResNet152, as a neural transfer approach. The presented framework uses the weight obtained from the ImageNet dataset, fine-tuned by the dataset used in the work. The effectiveness of the suggested COVID-19 prediction system is evaluated experimentally and compared with DenseNet, another transfer learning model. The recommended ResNet152 transfer learning model exhibits improved performance and has a 99% accuracy when analogized with the DenseNet201 transfer learning model. © 2022 IEEE.

A CNN Transfer Learning -Electrocardiogram (ECG) Signal Approach to Predict COVID-19

Deep learning is increasingly gaining traction in cutting-edge medical sciences such as image classification, and genomics due to the high computational performance and accuracy in evaluating medical data. In this study, we investigate the cardiac properties of ECG Images and predict COVID-19 in a binary classification of patients who tested positive for COVID-19 and Normal Persons who tested negative. We analyzed the electrocardiogram (ECG) images by preprocessing the ECG data and building an ECG- Deep Learning- COVID-19 (ECG-DL-COVID) classifier to predict disease. The deep learning models in our experiments constituted CNN, Multi-Layer Perceptron (MLP), and Transfer Learning. Performance evaluation was done to compare the effectiveness of the proposed methodologies with other COVID-19 deep learning-related works. In the three experiments, we achieved an 87% prediction accuracy for MLP, a 90% prediction for CNN and a 93.8% prediction for Transfer Learning. Experimental results and performance evaluation show that the proposed models outperformed previous deep-learning models in the prediction of COVID-19 by a considerable margin. © 2023 IEEE.

RES-KELM fusion model based on non-iterative deterministic learning classifier for classification of Covid19 chest X-ray images

In this research, a novel real time approach has been proposed for detection and analysis of Covid19 using chest X-ray images based on a non-iterative deterministic classifier, kernel extreme learning machine (KELM), and a pretrained network ResNet50. The information extraction capability of deep learning and non-iterative deterministic training nature of KELM has been incorporated in the proposed novel fusion model. The binary classification is carried out with a non-iterative deterministic learning based classifier, KELM. Our proposed approach is able to minimize the average testing error up to 2.76 on first dataset, and up to 0.79 on the second one, demonstrating its effectiveness after experimental confirmation. A comparative analysis of the approach with other existing state-of-the-art methods is also presented in this research and the classification performance confirm the advantages and superiority of our novel approach called RES-KELM algorithm.

Computerized Face Mask Detection System Using Deep CNN and Transfer Learning

Since the COVID-19 pandemic is on the rise again with hazardous effects in China, it has become very crucial for global individuals and the authorities to avoid spreading of the virus. This research aims to identify algorithms with high accuracy and moderate computing complexity at the same time (although conventional machine learning works on low computation power, we have rather used CNN for our research work as the accuracy of CNN is drastically greater than the former), to identify the proper enforcement of face masks. In order to find the best Neural Network architecture we used many deep CNN Methodologies to solve classification problem in regards of masked and non masked image dataset. In this approach we applied different model architectures, like VGG16, Resnet50, Resnet101 and VGG19, on a large dataset to train on and compared the model on the basis of accuracy in which VGG16 came out to be the best. VGG16 was further tuned with different optimizers to determine the one best fit of the model. VGG16 gave an ideal accuracy of 99.37% with the best fit optimizer over a real life data set. © 2023 IEEE.

Hybrid-Patch-Alex: A new patch division and deep feature extraction-based image classification model to detect COVID-19, heart failure, and other lung conditions using medical images

COVID-19, chronic obstructive pulmonary disease (COPD), heart failure (HF), and pneumonia can lead to acute respiratory deterioration. Prompt and accurate diagnosis is crucial for effective clinical management. Chest X-ray (CXR) and chest computed tomography (CT) are commonly used for confirming the diagnosis, but they can be time-consuming and biased. To address this, we developed a computationally efficient deep feature engineering model called Hybrid-Patch-Alex for automated COVID-19, COPD, and HF diagnosis. We utilized one CXR dataset and two CT image datasets, including a newly collected dataset with four classes: COVID-19, COPD, HF, and normal. Our model employed a hybrid patch division method, transfer learning with pre-trained AlexNet, iterative neighborhood component analysis for feature selection, and three standard classifiers (k-nearest neighbor, support vector machine, and artificial neural network) for automated classification. The model achieved high accuracy rates of 99.82%, 92.90%, and 97.02% on the respective datasets, using kNN and SVM classifiers.

Performance Analysis of VGG-16 Deep Learning Model for COVID-19 Detection using Chest X-Ray Images

COVID-19 is an infectious disease caused by newly discovered coronavirus. Currently, RT-PCR and Rapid Testing are used to test a person against COVID-19. These methods do not produce immediate results. Hence, we propose a solution to detect COVID-19 from chest X-ray images for immediate results. The solution is developed using a convolutional neural network architecture (VGG-16) model to extract features by transfer learning and a classification model to classify an input chest X-ray image as COVID-19 positive or negative. We introduced various parameters and computed the impact on the performance of the model to identify the parameters with high impact on the model's performance. The proposed solution is observed to provide best results compared to the existing ones. © 2023 Bharati Vidyapeeth, New Delhi.

Fine-Tuning ResNet-152V2 for COVID-19 Recognition in Chest Computed Tomography Images

The epidemic Covid-19 has extended to majority of nations. This pandemic is due to a contagious condition 'SARS-CoV-2', was identified by the the International Health association. In order to diagnosis this virus from 2D chest computed tomography (CT) images, we applied three different transfer learning algorithms: $VGG-19, ResNet-152V2$ and a Fine-Tuned version of $ResNet-152V2$. The different transfer learning models are used on three hundred and four exams where 74 are normal cases, 60 are community-acquired pneumonia (CAP) cases and 169 were confirmed corona-virus cases. The best accuracy value is reached by the fine-tuned $ResNet-152v2$ by 75% against 70% for the basic $ResNet-152v2$ and 66% for the $VGG-19$. © 2022 IEEE.

Robotic Assistance in Radiology: A Covid-19 Scenario

During the COVID-19 Pandemic, the need for rapid and reliable alternative COVID-19 screening methods have motivated the development of learning networks to screen COVID-19 patients based on chest radiography obtained from Chest X-ray (CXR) and Computed Tomography (CT) imaging. Although the effectiveness of developed models have been documented, their adoption in assisting radiologists suffers mainly due to the failure to implement or present any applicable framework. Therefore in this paper, a robotic framework is proposed to aid radiologists in COVID-19 patient screening. Specifically, Transfer learning is employed to first develop two well-known learning networks (GoogleNet and SqueezeNet) to classify positive and negative COVID-19 patients based on chest radiography obtained from Chest X-Ray (CXR) and CT imaging collected from three publicly available repositories. A test accuracy of 90.90%, sensitivity and specificity of 94.70% and 87.20% were obtained respectively for SqueezeNet and a test accuracy of 96.40%, sensitivity and specificity of 95.50% and 97.40% were obtained respectively for GoogleNet. Consequently, to demonstrate the clinical usability of the model, it is deployed on the Softbank NAO-V6 humanoid robot which is a social robot to serve as an assistive platform for radiologists. The strategy is an end-to-end explainable sorting of X-ray images, particularly for COVID-19 patients. Laboratory-based implementation of the overall framework demonstrates the effectiveness of the proposed platform in aiding radiologists in COVID-19 screening. Author

Hybrid deep neural network for automatic detection of COVID-19 using chest x-ray images

The 2019 coronavirus (COVID-19), started in China, spreads rapidly around the entire world. In automated medical imagery diagnostic technique, due to presence of noise in medical images and use of single pre-trained model on low quality images, the existing deep network models cannot provide the optimal results with better accuracy. Hence, hybrid deep learning model of Xception model & Resnet50V2 model is proposed in this paper. This study suggests classifying X-ray images into three categories namely, normal, bacterial/viral infections and Covid positive. It utilizes CLAHE & BM3D techniques to improve visual clarity and reduce noise. Transfer learning method with variety of pre-trained models such as ResNet-50, Inception V3, VGG-16, VGG-19, ResNet50V2, and Xception are used for better feature extraction and Chest X-ray image classification. The overfitting issue were resolved using K-fold cross validation. The proposed hybrid deep learning model results high accuracy of 97.8% which is better than existing techniques.

Res-CovNet: an internet of medical health things driven COVID-19 framework using transfer learning.

Major countries are globally facing difficult situations due to this pandemic disease, COVID-19. There are high chances of getting false positives and false negatives identifying the COVID-19 symptoms through existing medical practices such as PCR (polymerase chain reaction) and RT-PCR (reverse transcription-polymerase chain reaction). It might lead to a community spread of the disease. The alternative of these tests can be CT (Computer Tomography) imaging or X-rays of the lungs to identify the patient with COVID-19 symptoms more accurately. Furthermore, by using feasible and usable technology to automate the identification of COVID-19, the facilities can be improved. This notion became the basic framework, Res-CovNet, of the implemented methodology, a hybrid methodology to bring different platforms into a single platform. This basic framework is incorporated into IoMT based framework, a web-based service to identify and classify various forms of pneumonia or COVID-19 utilizing chest X-ray images. For the front end, the.NET framework along with C# language was utilized, MongoDB was utilized for the storage aspect, Res-CovNet was utilized for the processing aspect. Deep learning combined with the notion forms a comprehensive implementation of the framework, Res-CovNet, to classify the COVID-19 affected patients from pneumonia-affected patients as both lung imaging looks similar to the naked eye. The implemented framework, Res-CovNet, developed with the technique, transfer learning in which ResNet-50 used as a pre-trained model and then extended with classification layers. The work implemented using the data of X-ray images collected from the various trustable sources that include cases such as normal, bacterial pneumonia, viral pneumonia, and COVID-19, with the overall size of the data is about 5856. The accuracy of the model implemented is about 98.4% in identifying COVID-19 against the normal cases. The accuracy of the model is about 96.2% in the case of identifying COVID-19 against all other cases, as mentioned.

Medical image-based detection of COVID-19 using Deep Convolution Neural Networks.

The demand for automatic detection of Novel Coronavirus or COVID-19 is increasing across the globe. The exponential rise in cases burdens healthcare facilities, and a vast amount of multimedia healthcare data is being explored to find a solution. This study presents a practical solution to detect COVID-19 from chest X-rays while distinguishing those from normal and impacted by Viral Pneumonia via Deep Convolution Neural Networks (CNN). In this study, three pre-trained CNN models (EfficientNetB0, VGG16, and InceptionV3) are evaluated through transfer learning. The rationale for selecting these specific models is their balance of accuracy and efficiency with fewer parameters suitable for mobile applications. The dataset used for the study is publicly available and compiled from different sources. This study uses deep learning techniques and performance metrics (accuracy, recall, specificity, precision, and F1 scores). The results show that the proposed approach produced a high-quality model, with an overall accuracy of 92.93%, COVID-19, a sensitivity of 94.79%. The work indicates a definite possibility to implement computer vision design to enable effective detection and screening measures.